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DETAILED ACTION 



1. This action is responsive to the following communications: amendment, filed 7/10/2006. 

2. Claims 2, 4-5, 8-10, 13-15, 19, 21-22, 25-27, 30-32, 41-58 pending. Claim 58 has been added. Claims 
41, 45, 49, 50, 51, 53, 54, 55, 56, 57, 58 are independent claims. 



Claim Rejections - 35 USC§ 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the 
rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on sale in this 
country, more than one year prior to the date of application for patent in the United States. 

4. Claim 58 is rejected under 35 U.S.C. 102(b) as being anticipated by Pizano et al. (hereinafter 
Pizano), U.S. Patent Number 5,293,429 issued March 8, 1994. 

In regard to independent claim 58, Pizano discloses a method of acquiring data from a plurality of 
heterogeneous business forms (form recognition) (Pizano Abstract). Instead of matching an inputted form to a 
specific stored form which recognizes design/content of said inputted form, Pizano uses analysis of horizontal 
and vertical lines, as well as other rules (i.e. rules that characterize pattern classes, dictionaries, etc.), for 
eventual form recognition (see Pizano column 2 lines 39-55, column 3 lines 5-10, column 4 lines 41-67). 

Pizano discloses inputting a form(s) (Pizano column 2 lines 64-66). 

Pizano discloses identification of said form (Pizano column 2 lines 67-68 to column 3 line 2). 
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Pizano discloses acquiring information content from said inputted form (Pizano Figure 19). Pizano also 
discloses that business forms are typically used to collect or distribute data for conducting business (Pizano 
Abstract -at top). 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set 
forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall 
not be negatived by the manner in which the invention was made. 

6. Claims 4-5, 8-9, 21-22, 25-27, 30-31, 41-48, 50-57 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Pizano et al. (hereinafter Pizano), U.S. Patent Number 5,293,429 issued March 8, 1994, 
in view of Applicant's Admitted Prior Art (hereinafter AAPA). 

Regarding independent claims 41, and 45, Pizano teaches scanning (i.e., providing) a plurality of 
unknown forms. (Pizano, col. 2, lines 64-66; Fig. 1.) 

Pizano further teaches generation of a form map based on designs on said unknown form(s) for 
identifying information contained thereon inasmuch as Pizano's feature extraction is equivalent to the 
generation of a form map. (Pizano, col. 2, lines 64-66; Fig. 1). 

Pizano does not specifically teach said plurality of documents haying "a variety of formats not 
predefined 99 , nor does it teach "containing data in locations not predefined". However AAPA teaches at 
Specification page 2 lines 15-18, of specifying "a method. . .by means of a means for the same, of forms whose 
design and information is not known in advance". See also page 4 lines 9-13. Since Applicant admits that the 
above teaching is well known (Specification page 8 lines s 1-3 "On the whole, the means used in the present 
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invention are well known to a skilled person in the technical field,. . ."), therefore It would have been obvious to 
one of ordinary skill in the art at the time of the invention to apply AAPA to Pizano, providing Pizano a way to 
recognize a wide variety of forms that do not conform accordingly. 

Pizano further teaches searching and comparing the generated form map with stored, registered maps in 
a map storage means. (Pizano, col. 4, lines 58-67.) 

Pizano further teaches indicating agreement according to the limits for agreement when agreement is 
found inasmuch as Pizano discloses form identification as output when a match is achieved. (Pizano, col. 2, line 
67 - col.3, line 2.). Pizano does not specifically teach a "factQr of probability". However AAPA teaches at 
Specification page 6 lines 23-24: "All candidates are associated with a factor of merit or a probability that they 
are the current invoice 10". Since Applicant admits that the above teaching is well known (Specification page 8 
lines s 1-3 "On the whole, the means used in the present invention are well known to a skilled person in the 
technical field,. . ."), therefore It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply AAPA to Pizano, providing Pizano a way to judge the level of agreement for matching forms. 

Regarding dependent claim 4, claim 4 incorporates substantially similar subject matter as claimed in 
claim 41, and in further view of the following, is rejected along the same rationale. 

Pizano discloses "the use of horizontal and vertical lines as features for identifying a form." (Pizano, 
col 3, lines 5-6; Figs. 5 and 6.) 

Regarding dependent claim 21, Pizano discloses "the use of horizontal and vertical lines as features for 
identifying a form." (Pizano, col. 3, lines 5-6; Figs. 5 and 6.) 

Regarding dependent claims 5 and 22, Pizano discloses generating horizontal and vertical keys by 
dividing the unknown form into a pre-determined number of horizontal and vertical segments along x and y 
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axes, respectively, wherein each segment is equivalent to one horizontal or vertical key position. (Pizano, col. 6, 
lines 35-51; Fig 5.) 

Regarding dependent claims 8 and 25, Pizano discloses horizontal and vertical keys constituting line 
keys used in the searching and comparison step inasmuch as Pizano teaches the comparison of line key patterns 
during this step. (Pizano, col. 6, lines 36-40; Fig. 5.) 

Regarding dependent claims 9 and 26, Pizano does not teach sorting, but it would have been obvious 
to one of ordinary skill in the art at the time of the invention to modify Pizano to sort regions (i.e., line keys) in 
the storage means according to the number of markings inasmuch as it would have been obvious to extend 
Pizano's method of assigning one or no tags to a region (Pizano, col. 6, lines 55-59) to a method that assigns a 
plurality of tags to a region because one of ordinary skill would have recognized that this would have provided 
more information for the comparison step. 

In regard to dependent claims 42, 43, 44, Pizano teaches a knowledgebase (Pizano Figure 1 item 18). 
Claims 43, 44 incorporate substantially similar subject matter as claimed in claims 41 and 5, and are rejected 
along the same rationale. 

In regard to claims 46, 47, 48, claims 46, 47, 48 reflect the apparatus comprising computer readable 
instructions used for implementing the methods as claimed in claims 42, 43, 44, and are rejected along the same 
rationale. Pizano teaches a knowledgebase (Pizano Figure 1 item 18). 

In regard to independent claim 50, Pizano teaches scanning (i.e., providing) an unknown form(s). 
(Pizano, col. 2, lines 64-66; Fig. 1 .) 
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Pizano further teaches generation of a form map based on designs on said unknown form(s) for 
identifying information contained thereon inasmuch as Pizano 's feature extraction is equivalent to the 
generation of a form map. (Pizano, col. 2, lines 64-66; Fig. 1). 

Pizano further teaches searching and comparing the generated form map with stored, registered maps in 
a map storage means. (Pizano, col. 4, lines 58-67.) 

Pizano does not specifically teach searching stored identities from previously processed forms. 
However, However AAPA teaches at Specification page 2 lines 18-20, page 7 lines 3-5, and page 4 lines 9-13, 
of specifying an adaptive method including learning and registering of forms as patterns without filled-in text, 
with new line keys stored accordingly for future processing. Since Applicant admits that the above teaching is 
well known (Specification page 8 lines s 1-3 "On the whole, the means used in the present invention are well 
known to a skilled person in the technical field,. . .")> therefore It would have been obvious to one # of ordinary 
skill in the art at the time of the invention to apply AAPA to Pizano, providing Pizano a way to adaptively 
recognize a wide variety of forms that do not conform accordingly, making the recognition process more 
accurate. 

Pizano further teaches indicating agreement according to the limits for agreement when agreement is 
found inasmuch as Pizano discloses form identification as output when a match is achieved. (Pizano, col. 2, line 
67-col.3,line2.) 

In regard to independent claim 51, Pizano teaches scanning (i.e., providing) an unknown form(s). 
(Pizano, col. 2, lines 64-66; Fig. 1.) 

0 

Pizano further teaches generation of a form map based on designs on said unknown form(s) for 
identifying information contained thereon inasmuch as Pizano 's feature extraction is equivalent to the 
generation of a form map. (Pizano, col. 2, lines 64-66; Fig. 1). 

Pizano further teaches searching and comparing the generated form map with stored, registered maps in 
a map storage means. (Pizano, col. 4, lines 58-67.) 
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Pizano does not specifically teach ". . An the absence of any non-data containing documents inputted to 
said data processing apparatus before processing' 9 , and location information. However AAPA teaches at 
Specification page 2 lines 15-18, of specifying "a method. ..by means of a means for the same, of forms whose 
design and information is not known in advance". Since Applicant admits that the above teaching is well known 
(Specification page 8 lines s 1-3 "On the whole, the means used in the present invention are well known to a 
skilled person in the technical field,. . ."), therefore It would have been obvious to one of ordinary skill in the art 
at the time of the invention to apply AAPA to Pizano, providing Pizano a way to adaptively recognize a wide 
variety of forms that do not conform accordingly, making the recognition process more accurate. It is 
additionally noted that a "non-data containing document" is generally meaningless, since said document 
contains no data whatsoever, therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention for the skilled artisan not to input and/or store any such documents. 

Pizano further teaches indicating agreement according to the limits for agreement when agreement is 
found inasmuch as Pizano discloses form identification as output when a match is achieved. (Pizano, col. 2, line 
67 - col.3, line 2.) 

In regard to dependent claim 52, Pizano does not specifically teach comparing identities from 
previously processed forms. However, However AAPA teaches at Specification page 2 lines 18-20, and page 7 
lines 3-5, of specifying an adaptive method including learning and registering of forms as patterns without 
filled-in text, with new line keys stored accordingly for future processing. Since Applicant admits that the above 
teaching is well known (Specification page 8 lines s 1-3 "On the whole, the means used in the present invention 
are well known to a skilled person in the technical field,. . ."), therefore It would have been obvious to one of 
ordinary skill in the art at the time of the invention to apply AAPA to Pizano, providing Pizano a way to 
adaptively recognize a wide variety of forms that do not conform accordingly, making the recognition process 
more accurate. 
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Pizano further teaches indicating agreement according to the limits for agreement when agreement is 
found inasmuch as Pizano discloses form identification as output when a match is achieved (via comparison). 
(Pizano, col. 2, line 67 - col.3, line 2.) 

In regard to independent claim 53, Pizano teaches scanning (i.e., providing) an unknown form(s) on 
an apparatus. (Pizano, col. 2, lines 64-66; Fig. 1.) 

Pizano further teaches generation of a form map based on designs on said unknown form(s) for 
identifying information contained thereon inasmuch as Pizano 's feature extraction is equivalent to the 
generation of a form map. (Pizano, col. 2, lines 64-66; Fig. 1). 

Pizano further teaches searching and comparing the generated form map with stored, registered maps in 
a map storage means. (Pizano, col. 4, lines 58-67.) 

Pizano does not specifically teach "in the absence of any inputted templates for identifying said plurality 
of documents before processing", and "in the absence of fixed forms". However AAPA teaches at Specification 
page 2 lines 15-18, of specifying "a method. . .by means of a means for the same, of forms whose design and 
information is not known in advance". Since Applicant admits that the above teaching is well known 
(Specification page 8 lines s 1-3 "On the whole, the means used in the present invention are well known to a 
skilled person in the technical field,. . ."), therefore It would have been obvious to one of ordinary skill in the art 
at the time of the invention to apply AAPA to Pizano, providing Pizano a way to adaptively recognize a wide 
variety of forms that do not conform accordingly, making the recognition process more accurate. Regarding said 
disclosure, it is noted that since the design is not known in advance, Applicant's initial form can be reasonably 
interpreted as not being a "fixed form" (no pre-determined format) as far as the receiving apparatus is 
concerned. 

Pizano further teaches indicating agreement according to the limits for agreement when agreement is 
found inasmuch as Pizano discloses form identification as output when a match is achieved. (Pizano, col. 2, line 
67 - col.3, line 2.) 
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In regard to independent claim 54, claim 54 reflects the apparatus comprising computer readable 
instructions used for implementing the method as claimed in claim 50, and is rejected along the same rationale. 

In regard to independent claim 55, claim 55 incorporates substantially similar subject matter as 
claimed in claims 51, and 53, and is rejected along the same rationale. 

In regard to independent claim 56, claim 56 incorporates substantially similar subject matter as 
claimed in claim 41, and in further view of the following, is rejected along the same rationale. 

Pizano does not specifically teach said storing a document if said document does not coincide with any 
previously processed document. However AAPA teaches at Specification page 8 lines 30-32, that a form is 
saved in the map database if said document cannot ultimately be identified (via comparison, etc.). Since 
Applicant admits that the above teaching is well known (Specification page 8 lines s 1-3 "On the whole, the 
means used in the present invention are well known to a skilled person in the technical field,. . ."), therefore It 
would have been obvious to one of ordinary skill in the art at the time of the invention to apply AAPA to 
Pizano, providing Pizano a way to recognize a wide variety of forms that do not conform accordingly. 

In regard to independent claim 57, claim 57 incorporates substantially similar subject matter as 
claimed in claim 41 and is rejected along the same rationale. 

7. Claims 2, 10, 13-14, 19, 27, 30-31, 49 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Pizano and AAPA, as applied to claims 41 and 45 above, and further in view of Suzuki, U.S. Patent 
Number 4,933,979 issued June 12, 1990. 
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Regarding dependent claifns 2, and 19, Pizano teaches a component table associated with an image 
(i.e. a pictorial logo) (Pizano column 18 lines 5-10, Figures 15, 19). Pizano does not specifically teach the 
generated form map including an "object area list" with objects. Suzuki, however, teaches the storage of 
information sets for a set of reading areas, which are analogous to object area lists inasmuch as reading areas 
identify parts of a form and can contain objects such as text or images (Suzuki, col. 6, lines 1-3, 39-46), and 
provide the benefit of efficient and accurate form recognition. ((Suzuki, col. 17, lines 42-57.) Thus, it would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply Suzuki to Pizano, 
providing Pizano the benefit of an object area list for more accurate processing. 

Pizano does not specifically teach text and colors. However, Suzuki teaches both the recognition of 
characters (Suzuki, col. 6, line 66 - col. 8 line 5) and the recognition of different gradations of tones (Suzuki, 
col. 8, lines 15-44). One of ordinary skill in the art would have recognized that these features provided the 
benefit of recognizing more and more complex forms. Thus, it would have been obvious to one of ordinary skill 
in the art at the time of the invention to modify the combination of Pizano and Karnin to include text and colors 
as objects. 

Regarding dependent claims 10 and 27, Pizano does not teach the application of horizontal and vertical 
keys to objects in the object area list. However, in view of Suzuki's use of object area lists, noted above, it 
would have been obvious to one of ordinary skill in the art at the time of the invention to extend the application 
of Pizano 's use of horizontal and vertical keys, noted above regarding dependent claims 5 and 22, from lines to 
objects, because one of ordinary skill in the art would have recognized that Pizano's use of line keys in a co- 
ordinate system was an efficient and accurate way of locating objects. 

Regarding dependent claims 13 and 30, Pizano does not teach the comparison of a generated object 
key constituted by a horizontal and/or a vertical key position with a stored object key during a search procedure. 
However, in view of Suzuki's use of object area lists, noted above, it would have been obvious to one of 
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ordinary skill in the art at the time of the invention to extend the application of Pizano's use of line keys, noted 
above regarding dependent claims 8 and 25, to object keys because one of ordinary skill in the art would have 
recognized that such an object key precisely located the position of the object on the form. 

Regarding dependent claims 14 and 31, Pizano does not teach the sorting of object keys according to a 
number of markings. However, in view of Suzuki's use of object area lists, noted above, it would have been 
obvious to one of ordinary skill in the art at the time of the invention to extend the obvious modification of 
Pizano's method to sort line keys, noted above regarding dependent claims 9 and 26, to sort object keys 
according to the number of markings because one of ordinary skill in the art would have recognized that the 
number of markings gave additional weight in the comparison process. 

In regard to independent claim 49, Pizano teaches scanning (i.e., providing) a plurality of unknown 
forms. (Pizano, col. 2, lines 64-66; Fig. 1.). 

Pizano further teaches generation of a form map based on designs on said unknown form(s) for 
identifying information contained thereon inasmuch as Pizano's feature extraction is equivalent to the 
generation of a form map. (Pizano, col. 2, lines 64-66; Fig. 1). 

Pizano does not specifically teach said plurality of documents having "a variety of formats not 
predefined", nor does it teach "containing data in locations not predefined". However AAPA teaches at 
Specification page 2 lines 15-18, of specifying "a method. . .by means of a means for the same, of forms whose 
design and information is not known in advance". Since Applicant admits that the above teaching is well known 
(Specification page 8 lines s 1-3 "On the whole, the means used in the present invention are well known to a 
skilled person in the technical field,. . ."), therefore It would have been obvious to one of ordinary skill in the art 
at the time of the invention to apply AAPA to Pizano, providing Pizano a way to recognize a wide variety of 
forms that do not conform accordingly. 
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Pizano further teaches searching and comparing the generated form map with stored, registered maps in 
a map storage means. (Pizano, col. 4, lines 58-67.) 

Pizano further teaches indicating agreement according to the limits for agreement when agreement is found 
inasmuch as Pizano discloses form identification as output when a match is achieved. (Pizano, col. 2, line 67 - 
col.3, line 2.). Pizano does not specifically teach a "factor of probability". However AAPA teaches at 
Specification page 6 lines 23-24, of specifying "All candidates are associated with a factor of merit or a 
probability that they are the current invoice 10". Since Applicant admits that the above teaching is well known 
(Specification page 8 lines s 1-3 "On the whole, the means used in the present invention are well known to a 
skilled person in the technical field,. . ."), therefore It would have been obvious to one of ordinary skill in the art 
at the time of the invention to apply AAPA to Pizano, providing Pizano a way to judge the level of agreement 
for matching forms. 

Pizano teaches a component table associated with an image (i.e. a pictorial logo) (Pizano column 18 
lines 5-10, Figures 15, 19). 

Pizano does not specifically teach text and colors. However, Suzuki teaches both the recognition of 
characters (Suzuki, col. 6, line 66 - col. 8 line 5) and the recognition of different gradations of tones (Suzuki, 
col. 8, lines 15-44). One of ordinary skill in the art would have recognized that these features provided the 
benefit of recognizing more and more complex forms. Thus, it would have been obvious to one of ordinary skill 
in the art at the time of the invention to modify the combination of Pizano and Karnin to include text and colors 
as objects. 

8. Claims 15 and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pizano and 
AAPA as applied to claims 41 and 45 above, and further in view of Leung et al. (hereinafter Leung), U.S. 
Patent Number 5,642,288 issued June 24, 1997, filed November 10, 1994. 
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Regarding dependent claims 15 and 32, Pizano does not specifically disclose searching resulting a pre- 
defined number of requested probable candidates for the currently searched form. However, Leung discloses 
returning a predefined number of matches to the user, for user analysis, in the context of a document recognition 
and handling system. (Leung, col. 10, lines 1-22.) It would have been obvious to one of ordinary skill in the art 
at the time of the invention to have modified Pizano to include Leung's step of returning a pre-defined number 
of requested probable candidates for the currently searched form because one of ordinary skill in the art would 
have recognized that returning too many results would be confusing to the user, and that the more results 
returned, the less likely that some results would provide a match. 



Response to Arguments 

9. Applicant's arguments filed 7/10/2006 have been fully and carefully considered but are not persuasive. 
Applicant's arguments on pages 19-20 are currently moot. 

Applicant arguments on pages 16-18 of the amendment are substantially directed to the assertion that 
the examiner's use of Applicant's Admitted Prior Art (AAPA) is taken out of context and is mischaracterized. 
Applicant additionally asserts that no admission regarding the Specification as prior art is made, etc. 

The examiner respectfully disagrees. Paragraph [0028] of Specification filed 3/6/2003 states: "On the 
whole, the means used in the present invention are well known to a skilled person in the technical field, but the 
way in which they are coordinated to achieve the objects of the invention are innovative.". Since the means used 
in the present invention are discussed and described in Applicants specification at least in paragraphs 
[0020] to [0027], as well as paragraphs [0010] to [0016], said means encompass much more than hardware. It is 
the examiner's opinion that the scope of paragraph [0028] is not limited solely to paragraph [0027]. 
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It is respectfully noted that Applicant's Specification teaches the following: 

Specification page 2 lines 18-20 teaches "learning and registering of forms as patterns without filled-in 

text". 

Specification page 2 lines 21-24 teaches generation of a "form map", said form map compared to stored 
registered maps as a means for identification. 

Specification page 4 lines 11-13 teaches registering the "design of the form". 

Specification page 8 lines 23-26 teaches that if no match with any stored form map is achieved, then the 
following commences: "...interpretation 220 is performed in that self-learning with a form definition 224 is 
accomplished. The form definition consists of a template or a set of rules that describes the common elements of 
a specific collection of forms, for example, Swedish invoices." (holding added). 

It is respectfully submitted that a "template" can be fairly interpreted as a general "set of rules" that acts 
as a "guideline" for analysis. A form map can be fairly interpreted as a type of "predetermined template" 
providing a basis for comparison. It is predetermined because it has been previously registered accordingly. 
According to Applicant's Disclosure, if no matches to form maps (templates) are achieved, then a form 
definition (another template) is used. Some or all of this information must be pre-submitted at some point. 

Conclusion 

10. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth 
in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this 
final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no 
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event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of this 
final action. 

1 1 . Any inquiry concerning this communication or earlier communications from the examiner should be 
directed to William L. Bashore whose telephone number is (571) 272-4088. The examiner can normally be 
reached on 1 1:30am - 8:00pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Heather 
Herndon can be reached on (571) 272-4136. The fax phone number for the organization where this application 
or proceeding is assigned is 703-872-9306. 

12. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained from 
either Private PAIR or Public PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217- 
9197 (toll-free). 




WILLIAM BASHORE 
PRIMARY EXAMINER 

September 30, 2006 



